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We explore the computational complexity of computing pure Nash equilibria for a new class of strategic games 
called integer programming games with difference of piecewise linear convex payoffs. Integer programming 
games are games where players' action sets are integer points inside of polytopes. Using recent results from 
the study of short rational generating functions for encoding sets of integer points pioneered by Alexander 
Barvinok, we present efficient algorithms for enumerating all pure Nash equilibria, and other computations 
of interest, such as the pure price of anarchy, and pure threat point, when the dimension and number of 
"convex" linear pieces in the payoff functions are fixed. Sequential games where a leader is followed by 
competing followers (a Stackelberg-Nash setting) are also considered. 

Key words: algorithmic game theory, integer programming, Barvinok's generating functions, pure Nash 
equilibria, pure price of anarchy, pure threat point 



1. Introduction 

In this paper we introduce a new class of strategic games that have appeahng properties, and whose 
set of pure Nash equihbria can be described i n a co nvenient encodin g by rational generating func - 
tions using techniques pioneered by Barvinok (1994) and expanded bv lBarvinok and Woods ( 20031 ) . 
Generating functions techi iiques based on Barvi n ok's results hav e been applied to discrete opti- 
mization (see, for instance, De Loera et al. ( 20081 ), De Loera et al. ( 20071 )). and various other areas 
of applied and pure mathematics (see B for a survey). To the authors' knowledge 

this is the first application of the theory of rational generating functions to the study of games. 

This paper is motivated by open questions regarding the computational complexity of decid- 
ing the existence of pure Nash equilibria in s t rategi c games. For a general reference on complex- 
ity issues in game theory see iPapadimitrioul (j2007l ). As opposed to the case of mixed-strategy 
Nash equilibria which are guaranteed to exist for every game , the general p roblem of deciding 
if a strategic game has a pure Nash equilibrium is NP-hard (jCottlob et al.l (|2005l ^1. In view of 
this difficulty, the problem has been explored under various restri c tions o n the actions and pa y- 



offs of the players; for instance, in gra p hical g ames (lAlvarez et al.l (l2005l ). iGottlob et aP (|2005l l1 



congestion games (Dunkel and Schulz ( 20081 ). Fabrikant et al. ( 20041 )) and action graph games 
( Jiang and Levton-Brown ( 200?! )). This paper continues this tradition, by introducing a class of 
games that will be shown to have convenient algorithms to decide if instances have pure Nash 
equilibria, and if they exist, to compute them. 

We consider integer programming games, which are simultaneous games where the players' actions 
(pure strategies) are lattice points (i.e., integer points) inside polytopes described by systems of 
linear inequalities. Since the sets of actions are given implicitly by the description of polytopes, they 
may be of exponential size with respect to the input size. In our setting, each player's payoffs are 
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given as difference of piecewise linear convex (DPLC) functions. As an aside, optimization problems 
involvin g the difference of conve x functions are a well-studied class of nonconvex programs (see for 
example iHorst and Thoai 

The main result of the paper is that the set of pure Nash equilibria of integer programming games 
with DPLC payoffs can be encoded as a short rational generating function in polynomial time when 
the number of players, dimensions of the polytopes that define the action sets and the number 
of "convex" linear pieces in the payoffs are all fixed. Although these conditions are restrictive, 
note that each player may have an exponential number of actions. Indeed integer programming 
games with DPLC payoffs are a subset of a general class of games where deciding if a pure Nash 
equilib rium exists is So-co mplete with a fixed number of players and exponential-sized strategy 



spaces 



Alvarez et aP 



Besides questions of complexity, a short rational generating function encoding is a convenient 
data structure for answering other questions of interest regarding the structure of pure Nash 
equilibria and related concep ts. For instance, several questions analogous to those explored in 
Conitzer and Sandholm regarding mixed strategy Nash equilibria can be answered efficiently 



in our setting for pure Nash equilibria by using the rational generating function data structure. 
We feel the main contributions of the paper are: 

• Introducing the use of Barvinok short rational generating functions to the study of strategic 
games and demonstrating the power of encoding sets of pure equilibria as generating functions. 

• Presenting a tractable class of games, integer programming games with DPLC payoffs, for 
which pure strategy Nash equilibria and related quantities can be computed in polynomial time 
when certain dimensions are fixed. 

Also of note are two ideas used in several places in this paper: 

• In order to represent sets of equilibria, or other sets of interest, as rational generating functions 
we express the set as an overall feasible set in which unwanted elements, expressed as the union of 
projections of lattice point sets in polytopes, are removed. See for instance the proof of Theorem [5] 
where the set of pure Nash equilibria is defined in this way. This is a general technique that is 
adapted to various settings in Sections S] to [6l 

• Some results are easier to show when the actions for each player in the game are extended to 
include a component that captures the payoff of that player. This extension allows for descriptions of 
extended strategy profiles and equilibria that are more amenable to generating function techniques 
and can readily be converted back to normal strategy profiles and equilibria. See for instance 
Definition [3l 

The paper is organized into the following sections. Section [2] introduces integer programming 
games and discusses an application of this framework to a model of competing firms producing 
identical indivisible goods. Section [3] reviews the basic theory of Barvinok generating functions and 
major results that will be used in the remainder of the paper. Section[3]discusses pure Nash equilibria 
and contains the main contributions of the paper - demonstrating how generating functions can 
be used to encode sets of pure Nash equilibria. Section [5] details several other applications of 
generating function constructions to the computation of Pareto optima, the price of anarchy, and 
pure minmax values. Lastly, Section [6] describes a sequential (Stackelberg-Nash) version of an 
integer programming game where a leader's actions affects the description of the polytopes defining 
the actions sets of a group of followers, who then play a simultaneous game. 



2. Integer Programming Games 

We begin by introducing the following class of strategic games: 

Definition 1 (Integer Programming Game) . An integer programming game with n players 
is a noncooperative game where the Si of actions for each player i is the set of lattice points inside 
a polytope; that is, 

S, = P,^Z''^ (1) 
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where = {x € M^* : MjX < b^} is a rational polytope. 

Let I = {1, . . . , n} denote the set of players. The set S of action profiles s = (si, . . . , s„) is the 
Cartesian product of the S'^'s: 

n 

1=1 

where d = di + ■ — \-dn- The payoff functions are integer- valued of the form Ui : S for i £ I. 

As noted in the introduction, a distinguishing feature of this class of games is that the action sets 
Si are defined succinctly by linear systems M^x < b,;, even though 15^1 may be exponential in size 
with respect to the input size of Mi and 5^. We use rational generating functions to avoid explicitly 
enumerating each player's action set. 

Definition 2 (DPLC payoffs). An integer- valued payoff function u : 5 — > Z of a game is a 
difference of piecewise-linear convex functions or DPLC function if it can be expressed as: 

u(s) = max fi.(s) — max qAs) 

where the fk and gi are affine functions with integer coefficients and where K and L are finite index 
sets. We refer to the fk as the "convex" pieces of u and the gi as the "concave" pieces of u. 
We consider integer programming games where each player i has a DPLC payoff function 

Ut (s) = max f,k, (s) - max g,i^ (s) (2) 

again where the fik and gu are given affine functions with integer coefficients and the sets Ki and 
Li are given finite index sets. 

A first comment regarding this class of games is that they can express any finite game given 
in normal form. A normal form game is defined by action sets Ai, . . . ,An and payoffs 7ri(a) for 
a G ^1 X • • • X An and i G I. We refer to the set A = YVi=i the set of action profiles. A normal 
form game is finite is A is finite. We use the alternate notation Ai and tt^, as opposed to Si and Ui, 
for normal form games to draw a contrast between the fact that in normal form game the actions 
sets and payoffs for each action profile are given explicitly as part of the input, whereas in integer 
programming games the action sets Si and payoffs Ui are given implicitly. This contrast between 
implicit and explicit representations is important when o ne considers the computational complexity 



of finding pure Nash equilibria (see lAlvarez et al.l (|2005l ) for a technical discussion) . 



Proposition 1. Every finite normal form game is equivalent to an integer programming game 
with DPLC payoffs. 

Proof. Let finite normal form game G be defined by action sets Ai, . . . ,An and payoffs vri(a) for 
a E j4. Let di equal the number of elements in the action set A^. Let vector Xj = (xj^i, . . . , x^^^J 
denotes a mixed strategy profile for player i. Mixed strategy profiles x lie in the unit simplex: 

di 

P, = {x, = . . . , x.^di) G M''* : X, > 0, ^ x,j = 1}. 

i=i 

This is a polytope, and the lattice points inside Pi are exactly its vertices, which correspond to 
pure strategies (actions) for player i, namely, an action in Ai is represented by its characteristic 
vector Xi{o-i)- Thus, we represent the set of pure strategies for player i as 5^ = Pi (IZ'^k As above 
let = S*! X • • • X S'„. This conforms to the framework of integer programming games. 

As for the payoffs, our goal is to convert the explicitly given payoffs TTi over the set A of action 
profiles into equivalent DPLC payoff functions Ui over S. Let Af = {a G ^4 : 7ri{a.) > 0} and A^ = 
{a G ^ : iTi{a.) < 0}. For every x = (xi(ai), ■ ■ ■ , Xnian)) G S, define the DPLC payoff 

ti,(x) = max 7r,(a) x,^a, -n + l] - max 7r,(a) n - x^^a, - 1 • 
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Note that for every a € ^ we have • • • ,Xn(on)) = 7rj(a). Thus the normal form game G is 

equivalent to the integer programming game with pure strategy sets Si and DPLC payoffs Ui. □ 
Note that this representation has the same input size as the normal form game itself. Further 
computational complexity consequences of this proposition are discussed in Remark [2l 



Another useful result demonstrates the power of modeling payoffs as DPLC functions. IZalgaller 



(|2000l . Theorem 4.2) shows that every continuous piecewise linear function can be represented as 



the difference of two piecewise linear convex functions. Thus, a DPLC function can be used to 
describe any continuous piecewise linear payoff function, which in turn can be used to approximate 
an arbitrary continuous payoff function. 

Example 1 (Cournot game with indivisible goods and fixed production costs). 
A set of n manufacturers (the players) produce indivisible goods which are then sold in a market. 
Player i chooses an integer production level s,y for each of its indivisible products j € {1,. . . ,di} 
subject to resource constraints M^s^ < where s^ = {sn, . . . , SidJ. Thus, player i's action set 5^ is 
the set of integer points in a polytope in M'^'. The payoff to each player consists of revenues and 
production costs. Under usual assumptions, the revenue to each player z is a concave function of 
the action profile s, which can be expressed as a piecewise linear concave function min;gfl. ri;(s). 
For each player i and product j there may be a fixed production cost F^j . The variable production 
cost is a convex function of the production levels s^ expressed as a piecewise linear convex function 
max/gQ Cii{si). The payoff to player i is thus 



Ui{s) = ^max{-Fy , -FySy } - ( max(-rii(s)) +maxcii(si) 



which can be expressed as a DPLC function. As will be discussed further in Remark [3l this is 
precisely the structure that is analyzed in this paper. 

3. Introduction to rational generating functions 

We give a very b rief overview of the theory of short rational generating functions used in this paper. 
Barvinok introduced an algorithm for determining the exact number of lattice points in a 



rational polytope P = { x E M" : Ax < b } , that runs in polynomial time for every fixed dimen- 



sion n . This algorithmic breakthrough provided a strengthening of the famous algorithm of lLenstra 



which allows to decide whether P contains a lattice point in polynomial time for every fixed 



dimension. 

Barvinok's method works as follows. Consider the generating function of the lattice point set Pn 
Z", which is defined as the multivariate Laurent polynomial 

9{p;$)= E ^''= E er---eez[er,---,e]- (3) 

This Laurent polynomial, when encoded as a list of monomials, has exponential encoding size. 
Barvinok's algorithm computes a different representation of the function g{P; ^) as a sum of basic 
rational functions in the form 

9iP; ^) = (1 _ ^d,i)(l _ ^d,2) . . . (1 _ ^d,„) ' 

where I is a polynomial-size index set and all data are integer. This algorithm runs in polynomial 
time whenever the dimension n is a fixed constant. A formula of the type (jH) is called a short 
rational generating function. 

Note that each of the basic rational functions has poles (the point ^ = 1 in particular is a pole 
of all the basic rational functions), but after summing up only removable singularities remain. 
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Obtaining the exact number of lattice points of P is easy in ([3|), since clearly |PnZ"| = g{P;l). 
Since ([1]) is a formula for the same function (except for removable singularities), we also have 
|PnZ"| = lim^^i (^(P; which can be evaluated in polynomial time by performing a residue 
calculation with each basic rational function in the sum Q- An important point to note is that this 
evaluation is possible with arbitrary rational generating functions that correspond to finite lattice 
point sets. In other words, if we can compute in polynomial time a rational generating function 
of a finite lattice point set 5 C Z", we can also compute in polynomial time its cardinality 
Therefore, we can also decide in polynomial time whether 5 7^ 0. 

A first, trivial observation that allows to combine rational generating functions is the follow- 
ing. Let X C Z" and y € Z'' be lattice point sets given by their short rational generating func- 
tions g{X;^) and g{Y;ri). Then the direct product (Cartesian product) X xY also has a short 
rational generating function that is simply the product of the rational functions: 

giXxY;tv)=9{X;^)xg{Y;r,). 



Barvinok and Woodd (|2003l l developed powerful algorithms to obtain short rational generating 



functions of more general lattice point sets. The first of these algorithms concerns constant-length 
Boolean combinations of finite lattice point sets that are already given by rational generating 
functions. 



Th eorem 1 (Boolean Operations Theorem). (Corollary 3.7 in iBarvinok and Woods 
(2003')) Let m and £ be fixed integers, and let (j): {0,1}™ — > {0,1} he any Boolean function such 
that 0(0) = 0. Then there exists a constant s = s{i,m) and a polynomial-time algorithm for the 
following problem. Given as input, in binary encoding, 

(11) the dimension n and 

(12) rational generating functions 



of m finite sets S'p C Z", represented by the rational numbers 'jpi, integer vectors Cp, and dp^ 
forp = l,...,m,iGlp, j = l,..., i^^p such that the numbers £„ip of terms in the denominators 
are at most I, 
output, in binary encoding, 

(Oi) rational numbers 'ji, integer vectors c^, dij for i , j = 1, . . . ,Si, where Si < s, such that 



^"(l_^d.,)...(i_^d„ 



is a rational generating function of the finite set S that is the Boolean combination of 
Si, . . . ,Sp corresponding to the function 4>. 

Note that the restriction i?5>(0) = ensures that the set S will be finite. The essential part of 
the construction of Theorem [J is the implemen tation of set intersections, which are based on the 



Hadamard product ( Barvinok and Woods 20031 . Definition 3.2), which is the bilinear extension of 



the operation defined on monomials as 



ax^ * a x^ = < 

otherwise. 



With this definition, clearly 

9{Slr^S■2)=g{Sl■i)*g{S^■i). 
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Another powerful method to define lattice point sets is by integer projections. Let S Q Z" be a 
finite lattice point set, given by its rational generating function g{S;$,). Let -0: Z" ^ Z*^ be a linear 
function and denote by T = '0(5') the image (projection) of S. If the map ip is one-to-one (injective) 
from S, then the generating functio n q(T\ t)) of the projection T can be computed by making a 
monomial substitution in g{S;^); see iBarvinok and Woods (|2003l . Theorem 2.6). This fact is used 



in the proof of Corollary [2j 

When 5* is the set of lattice points in a polytope P, the integer projection method of 
Barvinok and Woodsl (|2003l 'l can be employed to construct a rational generating function of the 



projection T. 

Theorem 2 (Projection Theorem). (Theorem 1.7 in IBarvinok and Woodsl ( 20031 )1 Let the 



dimension n be a fixed constant. Then there exists a constant s = s{n) and a polynomial-time 
algorithm for the following problem. Given as input, in binary encoding, 

(11) an inequality description of a rational polytope P C M"; 

(12) a positive integer k; and 

(13) a linear map tp: "L"^ ^iJ' given by an integral matrix; 
output, in binary encoding, 

(Oi) rational numbers 7^, integer vectors Ci, d^j for i & I, j = 1, . . . , s^, where Si < s, such that 

is a rational generating function of the set T = il:{P fl Z"). 

Once a rational generating function of a set S has been computed, various pieces of information 
can be extracted from it. We have already mentioned that it is possible to compute the cardinality 
of S In addition to that, we can explicitly enumerate all elements of S. Since the cardinality of S 
can be exponential in the encoding length of the input, we use output-sensitive complexity analysis, 
i.e., to measure the complexity of the enumeration algorithm in terms of both the input and the 
output. The strongest notion of an output-sensitive polynomial-time enumeration algorithm is that 
of a polynomial- space polynomial- delay enumeration algorithm. Such an algorithm only uses space 
that is polynomial in the encoding length of the input data. In addition, the time spent between 
outputting two items, and before outputting the first item and after outputting the last item, is 
bounded by a p olynomial in the e ncodi ng length of the input data. The following result is a version 
of Theorem 7 of lOe Loera et all (l2007l ). 



Theorem 3 (Enumeration Theorem) . Let the dimension k and the maximum number i of 
binomials in the denominator be fixed. Then there exists a polynomial- space polynomial- delay enu- 
meration algorithm for the following enumeration problem. Given as input, in binary encoding, 

(11) a number M € Z+; 

(12) rational numbers 'ji, integer vectors c^, dy for i ^ I, j = 1, . . . where ii<£ such that 



E 

lei 



(l-s[J")(l -zd«2 )...(! _s;J- 



is a rational generating function of a set y C Z'^ of lattice points with V Q [—M, M]'^ ; 
(I3) an integer p with 1 <p<k 
output, in binary encoding, 

(Oi) all points in the projection ofV onto the last p components. 



W = {weZP:3teZ''-P such that {t,w)eV}, 



in lexicographic order. 
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In addition, binary search can be used to optimize a linear function over a lattice point set 
encoded clS cl rational generating function. 

Theorem 4 (Linear Optimization Theorem) . Let the dimension k and the maximum num- 
ber i of binomials in the denominator be fixed. Then there exists a polynomial-time algorithm for 
the following problem. Given as input, in binary encoding, 

(Ii) and (I2) as in Theorem\M 

(I3) a vector f G Z*"', 
output, in binary encoding, 

(Oi) an optimal solution v* G Z'^ of the optimization problem max{ (f, v) : v € F }. 

We will use all the above results in the following constructions. 



4. Calculating Pure Nash Equilibria in Integer Programming Games 

Consider an integer programming game with DPLC payoffs as defined in Section [2j Our goal is to 
encode the Nash equilibria of such a game as a short rational generating function. The most general 
setting we provide an efficient algorithm for such an encoding is when the number of players and 
the dimension of their action sets are fixed and each player's DPLC payoff function has the form: 

u, (s) = max fik (s) - max gu{s) (5) 

where we now assume that the size of Ki is a fixed. Since S is bounded we assume without loss 
of generality that Ui{s) > for all i G I and s € 5". The analysis proceeds with two fundamental 
insights. First, when there are a fixed number of "convex" pieces, i.e., when \Ki\ is fixed, each 
player's payoff is piecewise linear concave within the region where an fi^s remains maximum. The 
second insight is that when payoffs are piecewise linear concave the hypograph of the payoff function 
is then a polyhedral set, encodable as a short rational generating function. 

First, a simple result towards partitioning the action profile space into regions according to the 
values of the linear pieces of the payoffs. We assume that Ki is a totally ordered set. 

Lemma 1. For each player i, the set of all action profiles can be expressed as a disjoint union 

S= 1+J 



where 



j>k 
j<k 



Proof. We first show that S = U^gK ^ik and later establish it is a disjoint union. Clearly 
Ufeeif 'S'ifc ^ S. It remains to show the reverse inclusion. Let s £ S and define J(s) = {j € Ki : 
fikis)=maXk<zK,fikis)} and i(s) =min J(s), then s G (s). 

To show that the union is in fact disjoint suppose by contradiction that there exists an s in 
Sik n Sik' where k > k' . If k > k' then since s G Siu this implies fik{s) > /ifc'(s). However, since 
s G Sik' this yields that fik'{s) > /ifc(s), a contradiction. The result follows. □ 

Note that we could equivalently write Sik as follows. 



e _ j q. f^k{s)>f^J{s), j>k\ 
""^-r^"- /.fc(s)>^(s) + l, j<kj 



We can do this because the action profiles in S are integer vectors and the data defining the 
functions are integral. The same holds true for all the strict inequalities in this paper, and thus 
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the alternative descriptions using a strict inequality or a weak inequality with one unit added to 
the larger side of the inequality are used interchangeably throughout. 

The next step is to refine the partition of S to account for all players simultaneously. To do 
so we introduce the following convenient notation. Let K = n"=i be the set of all vectors k = 
(ki, . . . ,k„) of indices where ki G Ki for i G /. Using this notation, denote by 5k the intersection 
Siki n ■ • ■ n Snkn ■ Employing this notation we state the following simple corollary of the previous 
lemma: 

Corollary 1. The set of action profiles can be partitioned as follows: 

S= l+J Sk 

keK 

Thus each action profile s lies in a unique subset S'k of S where it is known that the payoff for 
each player i is 

Ut{s) = /jfc^(s) +min5,,(s) 

and hence a piecewise linear concave function of s. To take advantage of this concave structure in 
the payoff we propose an extension of the game. 

Definition 3 (Extended Game) . Given an integer programming game with DPLC payoffs let 
s = (s; y) = (si, . . . , s„; yi, . . . , y„) denote an extended action profile which includes variables j/i G Z 
which keep track of payoff values. The set S of extended action profiles is the set 



^=l+JSk (6) 



keK 



where 



S'k = {s = (s, y) : s G S'k and < < f,k{s) - g^l (s) for all / G L, and i G /}. 



By Corollary [T] it is easy to see that ([U]) is a disjoint union. 
We define the extended utility function Ui for each player i as 

Ui{St) = Vi 

which is a linear function on S. We call the tuple G = (S, -Ui, . . . , n„) the extended game of the 
original game G = {S,Ui, . . . ,u„). 

At this point there are three important observations regarding the definition of extended games. 
Note that since S is a bounded by a polytope and the constraints < y^ < /ifc(s) — gii{s) for all I G 
Li and i € I bound the values of y^ it follows that each Sk, and thus S is bounded. This fact will be 
important when encoding S' by a rational generating function and applying the Linear Optimization 
Theorem, which we have occasion to do in what follows. Note also that 'Uj(sj) is a linear function 
over S and thus more amenable to encoding by generating functions than the piecewise linear 
payoffs of the original game. 

We also remark that the extended game G is not a simultaneous-move game since the players' 
choices are not independent and som e choices of s may lead to infeasibility. Similar issues are 
explored in iBhattachariee et al.l (|2000l ): however, we do not treat the extended game G as a game 



unto itself, but simply as a mathematical construct to study the equilibria of the original game G, 
and we thus ignore these considerations. 

A key step is to establish a correspondence between the pure Nash equilibria to those of the 
original game. As will be seen, this correspondence relies on the fact that the descriptions of the 
action profile sets involve disjoint unions. 
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In analyzing games we often consider deviations from the vector k = (/ci, ...,/;;„) in which the i-th 
component ki is replaced with k[ & Ki. For convenience, let k_i denote the vector of the remaining 
(unchanged) indexes; therefore, 

(k_j, A;.-) = {ki, . . . , ki^i, k,^, fci+i, . . . , k^)- 

We follow a similar convention in terms of action profiles. Namely, given an action profile s = 
(si, . . . ,s„), if player i deviates to action then we let s_,; denote the (unchanged) actions of the 
remaining players, so 

(s_j; , Sj) (Sl , . . . , Sj_i , Sj , Sj^i ; • • • ) S„) . 

The equilibrium concept used in the extended game is defined as follows: 

Definition 4 (Extended pure Nash equilibrium). Let G= (S*, Ui, . . . , m„) be an extended 
game. An extended pure Nash equilibrium s = (s;y) is an extended action profile where if s € 
then there does not exist s[ = (s';,?/Q such that (s_i,s/) G 5'(k_j,fe') and 'Uj(s_j,s/) > Ui{s). 

Lemma 2. Consider the game G = {S,Ui, . . . ,u„) and its extended game G = {S,Ui, . . . ,«„) as 
defined above. 

(i) An extended pure Nash equilibrium of G must be of the form 

s= (s;u(s)) = (si,...,s„;'Ui(s),...,n„(s)). (7) 

(ii) There is a bijection between the set N of pure Nash equilibria of the original game and the set 
N of extended pure Nash equilibria of the extended game. 

Proof, (i) Let s = (s;y) G S. By the disjoint union ([6]) there exists a unique k such that s G 
It follows that s G ^k. For all i G we have s G S'^^. and < /ifcj(s) — max^g^^ fi'ii(s) = Ui{s). Thus, 
Ui{s) =yi <Ui{s) = ^^(si, Mi(s); . . . ; s„, u„(s)). Hence, whenever yi <nj(s) it is profitable for player 
i to deviate to the extended action {si;Ui{s)). Therefore, an extended pure Nash equilibrium must 
have the form ([7]). (ii) Consider the mapping (p : N — > defined by s i — > (s;ti(s)). We claim is 
a well-defined bijection. First we show that (p is well-defined, that is (/?(s) G A^ for all s G A^. Clearly 
ip{s) is in S. Let s G ^k for some k. Now consider a feasible deviating action for player i, s- = (s^, y^), 
where (s_i,Sj) G 5'(k_-,fe') for some A;- G Ki. In other words, player i deviates from choosing G 5^^. 
to choosing s- G Siy, and changing y.^ to y[. We have 

u,(s„i, S-) = y[ < u,(s_i, S-) < u,{s) = Ui{s) 

where the second inequality holds since s is a Nash equilibrium for the game G and the final equality 
follows from (i). It follows that s is an extended Nash equilibrium for the game G and mapping ip 
is well-defined. 

It is clear that if is injective. As for surjectivity, by part (i) if follows that every Nash equilibrium 
in A^ has the form (s; u{s)) for some s G 5. It just remains to show that all such equilibria arise with 
s G A^. Suppose the contrary, that is s = (s; n(s)) G A^ but s ^ N. Then there must be a profitable 
deviation s- G Si for some player i in the original game G; ni(s_j, s-) > Ui{s). This implies that there 
is a profitable deviation s- = (s^; tii(s_i, s^)) in the extended game since 

n,(s) =u,{s) < Uj(s_,,s^) =-u,(s_,,s[). 

□ 

With this bijection, we can now state the main result of the paper: 

Theorem 5. Consider an integer programming game with DPLC payoffs given by the following 
input in binary encoding: 
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(11) the number n of players, and a bound B E N; 

(12) for each i ^ I = {l,...,n}, the dimension di and an inequality description (M^jb^) of a 
rational polytope = {x G : M,x < bj C S]'*"; 

(13) for each i £ I, nonnegative integers \Ki\ and \Li\, and for all integers k, I such that 1 < A; < 

\Ki\ and 1 < j <\Li\, integer vectors O-ik € Z'^, 7^/ € Z'^ (where d = di-\ \-dn) and integers 

Pik, ^ik defining the affine functions fik ■ S and gn : S by fik{s) = cxi^ ■ s + [dik and 

(7,,(s) = 7,r s + /or a// s G 5 = nr=i(^* n Z-^' )- 
The set N of extended pure Nash equilibria of the extended game G = . . . ,u„) has a short 

rational generating function encoding, which can be computed in polynomial time when the total 
dimension d and the sizes \Ki\ are fixed for all i £ I . 

Proof. We express the set of extended Nash equihbria as follows: 

n 

n = s\\Jd, 

i=l 

where 

l±) U P'^ojs{(s>s-) :sG5k, (s_i,s-) G5(k_,,fe^), ^^(s^,,^^) >ni^ (8) 

k6K k'^eK, 

Note that some of the projected sets may be empty. 

The set is the set of action profiles where player i has a profitable deviation. The description 
of Di in (l8|) is a union over profitable deviations from one set in the partition of S to another. This 
description of A'^ is easy to verify using the definition of extended pure Nash equilibria. 

We now establish that N can be encoded as a short rational generating function. First we claim 
S admits such an encoding. Consider the description of S given in ([6]). The sets Fij^ are sets of 
lattice points inside rational polytopes and thus encodable as short rational generating functions. 
This in turn implies that admits such an encoding since it in turn is the set of lattice points 
inside a polytope. By the Boolean Operations Theorem, it follows that S can be encoded as a short 
rational generating functions in polynomial time, since there is a constant number of sets under 
the assumption that the sets I and Ki are of fixed size. 

Note in addition that the sets to be projected in ([8]) are again sets of lattice points inside of 
rational polytopes, by observing that the extended payoffs functions are linear. By the Projection 
Theorem it follows that each set in the union can be encoded as a short rational generating function. 
Using again the Boolean Operations Theorem we conclude that each Di, and thus N, admit short 
rational generating function encodings which can be computed in polynomial time when the sizes 
of the sets Ki are fixed for all i € I. We remark that the outer union in ([8|) (indexed by k G K) 
is a disjoint union; thus its rational generating function can be computed by adding the rational 
generating functions of the parts, rather than using the construction of the Boolean Operations 
Theorem. □ 

Corollary 2. Consider an integer programming game with DPLC payoffs given by the same 
input as in Theorem [31 The set N of pure Nash equilibria has a short rational generating function 
encoding which can be computed in polynomial time when the total dimension d and the sizes \Ki\ 
are fixed for all i £ I. 

Proof. By the previous theorem, we can encode the set of extended pure Nash equilibria, N, in 
polynomial time. Using the bijective map if given in the proof of Lemma[2]we can use an appropriate 
monomial substitution in the rational generating function description of N to yield a short rational 
generating function encoding for A^. □ 
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The true power of the previous lemma hes in the fact that having a short rational encoding of a 
set allows for efficient counting, optimizing and enumerating procedures as discussed in Section [3l 
Using these techniques we can answer numerous questions of interest on the existence, uniqueness 
and structure of equilibria. 

Corollary 3. Consider an integer programming game with DPLC payoffs given by the same 
input as in Theorem [3 There is a polynomial time algorithm to compute the number of pure Nash 
equilibria, when the total dimension d and the sizes \Ki\ are fixed for all i G /. In addition, under 
the same assumptions there is a polynomial time algorithm to find a sample pure strategy Nash 
equilibrium, when at least one exists. 

Proof. Given the short rational generating function encoding of we calculate |A^| in polynomial 
time by counting methods discussed near the beginning of Section [3l If an equilibrium exists, we 
can output one by running the polynomial-delay enumeration algorithm on N described in the 
Enumeration Theorem and terminating just after one equilibrium has been generated. This can be 
done in polynomial time. □ 
Note that the algorithm runs in time polynomial in the total number of "concave" 

pieces in the payoff functions. This corollary can be used to answer the question of whether a 
unique pure Nash equilibrium exists - simply check whether |A^| = 1. The following result is also 
immediate by the Enumeration Theorem. 

Corollary 4. Consider an integer programming game with DPLC payoffs given by the same 
input as in Theorem O There is a polynomial- space polynomial- delay algorithm to enumerate all 
the pure Nash equilibria of the game when the total dimension d and the sizes \Ki\ are fixed for all 

iel. 

Reflecting on the content and context to the results of this section, we make the following useful 
remarks. 

Remark 1 . Considering the number of elements of the game we need to fix in Corollary [3] - 
fixed number of players, fixed dimension of the polytopes, fixed sizes of the Ki - one might ask 
if there is an alternate method to generating functions that might yield similar results. The key 
observation is that the action sets are described implicitly as lattice points in polytopes given 
by linear inequalities, and thus the number of actions for each player may be exponential in the 
input size. Thus, simple enumeration of all the action profiles in 5" is a computationally intractable 
approach to the problem. 

Remark 2. It was shown in Proposition [1] that every normal form game can be expressed as an 
integer programming game with DPLC payoffs. Note, however, that the dimensions of the action 
spaces are equal to number of corresponding actions in the normal form game. Indeed, using the 
notation of the proof of Proposition [T|, we have Si G Tj^k Prom a complexity point of view this 
representation is unsatisfactory. In Corollary [3] we require the dimension of the action spaces to be 
fixed, and thus we can only handle a fixed number of actions in the underlying normal form game. 
Normal form games with a fixed number of players and fixed number of actions are computationally 
uninteresting. 

Remark 3. The Cournot game in Example [T] fits the assumptions of Corollary O We assume 
that the number n of players (manufacturers) is "small", i.e., fixed, in order for each manufacturer 
to have appreciable market power. We also assume that the total number d of products is small. 
The sets Ki have cardinality 0(2'^'), which is fixed, and thus the decomposition of S in Corollary [1] 
is comprised of a constant number of subsets. Since the algorithm in Corollary [3] scales polynomially 
with the sizes of the sets Li, we can afford a variable number of "concave" pieces in the description of 
the payoff functions. These "concave" pieces are used to represent general concave revenue functions 
and the convex parts of the cost functions, when restricted to integer points. 
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5. Related computations 

In addition to counting and enumerating pure Nash equilibria, generating function techniques can 
be used to derive efficient algorithms for related computations for integer programming games. 
Several of these are discussed in the following subsections. 

First, note that the encoding of the set of Nash equilibria as a short rational generating function, 
being a compact representation, is useful for learning about the specific structure of a game's 
equilibria. For instance, a simple calculation suffices for deciding the existence of a pure Nash 
equilibrium where player i plays a given action s^. Indeed, simply find the short rational generating 
function encoding of 

N^^i') =Nn{seS:s, = s,}. 

in polynomial time under the same assumptions in the previous section. 
Now onto some more sophisticated calculations. 

5.1. Pareto optimality 

Consider the question of finding Pareto optimal pure Nash equilibria, if any exist, in an integer 
programming game with DPLC payoffs. To tackle this, we start by encoding the set of Pareto 
optimal action profiles of the game. 

Theorem 6. Consider an integer programming game with DPLC payoffs given by the same input 
as in Theorem O The set PO of Pareto optimal action profiles has a short rational generating 
function encoding, which can be computed in polynomial time when the total dimension d and the 
sizes \Ki\ are fixed for all i £ I . 

Proof. Thej^roof is similar to those in the proof of Lemma [2l Theorem [5] and Corollary [2) 

(i) Define PO as the set of Pareto optimal points in the extended game and find a generating 
function encoding for PO. 

(ii) Derive a bijection between PO and PO. 

(iii) Use the generating function of PO and the bijection to obtain the generating function of PO. 
For part ^ consider the following decomposition of PO: 

PO = {s € 5* : ^ s' E 5" such that (Uj(s') > Uj(s) for all j G /) and {ui{s) > Ui{s) for some i G /)} 

n 

= 5\|JPA 
where 

PDi= IJ projg |(s,s') : s G S'k, s G ^k', Uj{s)>u^{s) for all j 7^ ^, Uiis) >u,{s) + 1^ 

k,k'eK 

is the set of Pareto dominated points due to a better alternative for player i. By analogous arguments 
an in the proof of Theorem[5]we can encode PO as a short rational generating function in polynomial 
time. 

As for ([n]) the argument is nearly identical to that in the proof of Lemma [2] and is therefore 
omitted. Finally, (jm]) uses the same idea as found in the proof Corollary [2j □ 

Using the Boolean Operations Theorem we obtain a short rational generating function encoding 
of the set N f] PO of all Pareto optimal pure Nash equilibria of the original game: 

Corollary 5. Consider an integer programming game with DPLC payoffs given by the same 
input as in Theorem\^ The set of Pareto optimal pure Nash equilibria has a short rational generating 
function encoding, which can be computed in polynomial time when the total dimension d and the 
sizes \Ki\ are fixed for all i G /. 

As in Section [J] we can use this generating function encoding to count and enumerate Pareto 
optimal equilibria. 
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5.2. Pure prices of anarchy and stability 

The pure price of anarchy of a game measures the negative effects of competition on social welfare. 
The social welfare of an action profile is the corresponding total payoff of all players. The pure price 
of anarchy is the ratio of the maximum social welfare where the agents act together to maximize 
their total payoff to the worst social welfare that arises from a pure Nash equilibrium. The pure 
price of stability is the ratio of maximum social welfare to the best social welfare that arises from 
a p ure Nash equilibrium. Th e pure price of anarchy has been studied in various network games, 



Dunkel and Schulz and the references therein for recent results on weighted congestion 



see 

games. Using rational generating function techniques we can calculate the pure price of anarchy 
and stability efficiently. 

Theorem 7. Consider an integer programming game with DPLC payoffs given by the same input 
as in Theorem O There exist algorithms to compute the pure price of anarchy and the pure price 
of stability that run in polynomial time when the total dimension d and the sizes \Ki\ are fixed for 
all i^I . 

Proof. Let w* denote the maximum social welfare attainable under cooperation of the players; 
that is, 

w* = max I Ui (s) : s £ S I . (9) 
Again we work with the extended game. The first step in calculating w* is to note that 

^^*=max|^y,:(s;y)e5| (10) 

The equivalence of ([9]) and (jlOp is verified by first noting that for all (s;y) G 5, < Ui{s) = 
'Ui(s; ii(s)). Therefore, if (s*,y*) is an optimal solution to the right-hand side of (jlOp then we 
must have y* = Ui{s) for all i & N. This implies s is an optimal solution the right-hand side of ([9]). 

To find w* we optimize the linear function X^^yi over 5". Every (s,y) G S satisfies s G [—B,BY 
and 



Vz < u,{s) < B max(||Q,fc||i + -hmax(||7,i||i + \5u\ 

That is, (s;y) € [— M, M]''+" for some polynomially sized integer M. Since in Section H] we found 
a short rational generating function encoding of S, we apply the Linear Optimization Theorem to 
calculate w* in polynomial time. 

Let w denote the worst social welfare attained by a pure Nash equilibrium; that is, 

w = min < tii(s) : s € > . 



To calculate w we note 



w ■■ 



mini :(s;y)GiV 



which follows from Lemma [2]^i) . Using the short generating function encoding of N Q S found in 
Section H] we again apply the Linear Optimization Theorem to calculate w in polynomial time. 
Thus, we obtain the price of anarchy w* /w in polynomial time. 

The method for calculating the pure price of stability is similar. □ 
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5.3. Pure Threat Point 

The pure minmax value to player « in a game is defined as: 

min max Ui(Si,s_i). (11) 

Although mixed strategies are usually considered in calculating the (mixed) minmax values, here 
we restrict attention to pure strategies. The vector of mixed minmax values is known as the (mixed) 
threat point, which has drawn recent attention in the study of rep e ated g ames and explorations of 



computational implications of the Folk Theorem (see iBorgs et alj (|2007l )). Analogously, we define 
the pure threat point as the vector of pure minmax values. 

It was recently shown that, in various restrictive settings, the problem of calculating the (mixed) 
threat point is NP-hard. For instance, it can be shown that computing the (mi xed) threat point o f 



a three player game with binary payoffs ({0,1}) is NP-hard to approximate (see lBorgs et al.l (|2007l ) 
Theorem 1 for a precise statement and proof.) Despite this negative result we show that pure threat 
points can be computed efficiently in our setting. 

Theorem 8. Consider an integer programming game with DPLC payoffs given by the same input 
as in Theorem O There exists a polynomial time algorithm to compute the pure threat point when 
the total dimension d and the sizes \Ki\ are fixed for all i E /. 

Proof. We begin by demonstrating how to calculate the minmax value for player i in polynomial 
time for each player i. Observe that an optimal value to the following bilevel optimization problem 
is the pure minmax value of player i: 



min <^ u,(s,,s_i) : s_, G 5_i, s, € argmaxu,(s^, s_i) } . (12) 



This bilevel optimization problem (see IColson et al.l (|2007l )) has essentially two players: a lower 



level player, or follower, who is player i, and an upper level player, or leader, who represents all the 
other players cooperating to "punish" i. Let 

= {s e 5: s, G argmax{u,(si,s_i)}} 

denote the set of bilevel feasible solutions to (jl2p . Note that (|12p is equivalent to min{ui(s) : s G Gj}. 
As before we turn our attention to the extended game. We define the analogous set G^: 

= |s G 5 : Si G argmax{Mi(s_,,s,) : (s_i,s-) G S} 

Observe that if s = (s,y) G G; then = Ui{s). The set G^ can be expressed as G; = S\Di, where 
is defined as in ([5]). This follows since the optimization problem facing player i is the same problem 
as when determining extended Nash equilibria is a single player game. Thus by a direct application 
of Theorem [5] we can encode G^ as a short rational generating function. Note that G^ C S" C 
[— M, MY^^ where M is as defined in the proof of Theorem [71 By applying the Linear Optimization 
Theorem find the optimal value of niinyi : (s,y) G Gi =min{ui(s) : s G G;}, in polynomial time 
under the stated assumptions. The pure threat point can thus be calculated in polynomial time by 
finding the minmax value for each player. □ 
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6. Stackelberg— Nash equilibria 

We now turn to applying these techniques to a sequential setting. In a Stackelberg-Nash game, 
Player (the leader) chooses an action, described by a vector Sq G So- The remaining players i G 
/ = {!,..., n} (the followers) then simultaneously choose their actions s,; € S'i(so). Each player 
2 G /q = {0, 1, . . . , n} then collects a payoff Ui{sQ, s) where s = (si, . . . , s„). 

We assume So = PoH Z^" where Pq is a rational polytope. For each Sq G Sq the followers play an 
integer programming game with DPLC payoffs. The action of each follower i G / is described by a 
vector Si G Z'^' from the set S,{so) = P,{so)nZ'^K We assume -Pj(so) is the rational polytope 

P, (so) = {x G M.'^' : M,x < vr, (sq) } for iel 

where 7ri(so) is an integer valued affine function. Let d = di-\ — • + d„ and = do + d. 

Regarding payoffs, we assume each follower has a DPLC payoff u,;(s), independent of the leader's 
choice Sq and given by 

ti,(s) =max/,fe(s) -max5rj;(s). (13) 
The leader's payoffs are defined as the DPLC function 

^io(so,s) =max/ofc(so,s) -max5o;(so,s). (14) 

We assume all Ki and L,; are finite index sets and all fik and gu are integer valued affine functions. 

Observe that given Sq G Sq we have a setup identical to that of Section HI where the set of action 
profiles for the followers is S{sq) = HiLi ^ii^o) ^ 

We are interested in computing an optimal action for the leader while guaranteeing there exists 
a pure Nash equilibrium between the followers; see Remark [5] below for justification of our interest 
in pure Nash equilibria. Let A^(so) denote the set of pure Nash equilibria between the followers 
when the leader has chosen action Sq G Sq. As in Section [H a pure Nash equilibrium in N{sq) is an 
action profile s G ^(so) such that for every i G / there does not exist a deviation s'^ G ^^(so) such 
that Ui{s_i,s'^ > Ui{s). 

The leader faces the following optimization problem: 

max{no(so,s) : Sq & Sq and s G A^(so)}. (15) 

so,s 

Let denote the set of all Stackelberg-Nash equilibria, i.e., optimal solutions (so;s) to the opti- 
mization problem (jlSp . 

Remark 4. Note that this formulation implicitly assumes that the leader, after choosing Sg, can 
choose a pure Nash equilibrium s G A^(so) in order to maximize her payoff. This is a generalization 
to the case of competing followers of the "optimistic assumption" common in the multilevel opti- 
mization literature. The simplest illustration of the assumption is in the bilevel setti ng where the 



leader has the ability to choose among alternate optima to the follower's problem (see lColson et al 



(|2003)). 3ere we assume more generally that the leader can choose among the alternate pure Nash 



equilibria between the followers. 

Remark 5. The focus solely on pure strategies may need some motivation. Some choice of 
Sq G may give rise to no pure Nash equilibria in the followers' game, leaving only mixed Nash 
equilibria. We assume that the leader will avoid such an Sg, even if it gave rise to higher expected 
payoffs. Consider this as an extreme form of risk aversion, where any equilibrium in pure strategies 
in preferred by the leader so as to avoid any uncertainty in payoffs. By similar reasoning, we 
also assume the leader will not be interested in the mixed equilibria when pure equilibria exist. 
Extending the optimistic assumption discussed in Remark H] we assume the leader can compel the 
followers to reach a pure equilibrium whenever it exists. 
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Theorem 9. Consider a Stackelberg-Nash game with DPLC payoffs defined by the following 
input, given in binary encoding: 

(11) the number n of followers, and a bound B E N; 

(12) the dimension dg and an inequality description (Mo,bo) of a rational polytope Pq = {x € 
W^o : < bo} C [-B, Bj'^o defining the leader's feasible set 5o = Pq n Z'^o; 

(13) for each i ^ I = {l,...,n}, the dimension di, number rui of constraints, integer rui x di 
matrix Mi, integer do x matrix and integer vector ipi € Z™' defining the affine function 
vTj : 5*0 ^ Z™' by 7rj(so) = ^iSq + ipi, and defining the follower i's parameterized polytope 
P,(so) = {x G M'^-: M,x < ^,(so)}; 

(14) for each i £ I, nonnegative integers {K^l and \L.i\, and for all integers k, I such that I <k < 
\Ki\ and 1 < j < \Li\, integer vectors cxik € Z'', 7^; G 'L'^ (where d = di + ■ ■ ■ + dn) and integers 
Pik, ^ik defining the affine functions fik : Z'' ^ Z and ga : Z'^ ^ Z by /ife(s) = otik ■ s + and 
ga{s) = s + 6,1 for all s G Z'^; 

(15) nonnegative integers \Ko\ and \Lo\, and for all integers k, I such that 1 < k < \Kq\ and 
1 < i < l-^^ol; integer vectors 0.0^ G Z''^, 70/ G Z''''^ (where d'^ = do + d) and integers Pok, 6ok 
defining the affine functions fok : Z'' ^ Z and g^i : Z'' by /ofe(so, s) = a,k ■ (sq, s) + Pok 
and 5o;(so,s) =7o; • (so,s) + (^o; for all (so,s) G Z'* . 

Then there exists a polynomial-time algorithm to compute the leader's optimum payoff and a short 
rational generating function encoding of the set of all Stackelberg-Nash equilibria when the total 
dimension d'^ and the sizes \Kq\, \Ki\, . . . , \Kn\ are fixed. 

Proof. We mimic the development leading up to Theorem [5] in Section |4] by defining an extended 
game with extended strategy profiles (so,s,y) where yt < Ui{s) for all i G I. As before denote 
s = (s,y). Let 

S;k = {(so, s) : So G ^o, s G S{sq), /,fe(s) > fij{s) for j > k, fik{s) > (s) for j < k} 
and thus construct the disjoint union 

S= 1+J 

keK 

where 

= {(so,s,y) : So G 5*0, s G and < < /ifc(s) - ^^/(s) for ah I G L, and i G /}. 

denoting 5k = Siki n • • • n Snk„ ■ Note that 5k is a lattice point set in a polytope, and thus we can 
encode 5 by a short rational generating function. 

Let N denote the set of extended action profiles (so;s) such that Sq G 5o is any feasible leader 
action and s is a pure Nash equilibrium in the followers extended game when the leader has chosen 
So. Now express N as 

n 

n = s\[Jd, 

where 

Since all sets to be projected are lattice point sets inside polytopes, we can apply reasoning as in 
the proof of Theorem [5] and encode iV by a short rational generating functions under the stated 
assumptions. We establish a bijection between N and the set N = {(so,s) : So G 5o, s G A^(so)} 



(so, s) G 5k, 
(so, s, s J : (so, s_i, s,^ G 5(k_,,^) , 
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of feasible solutions to (fT5]) . We claim the function ip : N — > N defined by (so,s) i — > (so,s;m(s)) 
is a well-defined bijection. The details are similar to that in the proof of Lemma [2] and are thus 
omitted. Via this bijection we derive a short rational generating function encoding of by monomial 
substitution. 

Now, let A^^"^ denote the set of feasible solutions to (fT5|) that guarantee the leader a payoff of at 
least v: 

AtW =iVn({(so,s):no(so,s)>^;}) 

= iVn (J {(so,s) :/ofc(so,s)-5o/(so,s) >w V/ G Lq} . 

Note this is an intersection and union of polytopal lattice point sets. Since the size of is fixed we 
can apply the Boolean Operations Theorem to encode A^^") by a short rational generating function. 
Now, using binary search for v between —B^ and where 

B+ = b[ max(||Q!ofc||i + |/?ofc|) +max(||7o;||i + \5qi\) ) , 
\keKo leLo J 

and the counting algorithm to test for non-emptiness of A^^''^ we can find an optimal payoff to 
the leader. The set A^+ is therefore equal to A^^^ K □ 
As in the previous section, a short rational generating function encoding of the set A^+ of 
Stackelberg-Nash equilibria leads to results analogous to Corollary [3] and Corollary HI Thus, we 
can derive efficient procedures to decide on the existence of and to enumerate Stackelberg-Nash 
equilibria. 

7. Conclusions and directions for further research 

In this paper we introduced classes of games and proposed algorithms for studying their pure 
strategy Nash equilibria using rational generating functions. The simplicity by which they can be 
used to compute important information on the structure of these games, demonstrates the power 
of generating functions as an analytical and computational tool for game theory. 

There is considerable scope to explore applications of integer programming games to other situ- 
ations. In addition, the use of generating function techniques is a novel approach to game theory 
and can be applied to various types of games; e.g., threat point computations for repeated integer 
programming games; games with other payoff functions; and computations related to other solution 
concepts. 
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